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Abstract — The scope of this work is to provide a self-contained 
introduction to a selection of basic theoretical aspects in the 
modeling and control of quantum mechanical systems, as well 
as a brief survey on the main approaches to control synthesis. 
While part of the existing theory, especially in the open-loop 
setting, stems directly from classical control theory (most notably 
geometric control and optimal control), a number of tools 
specifically tailored for quantum systems have been developed 
since the 1980s, in order to take into account their distinctive 
features: the probabilistic nature of atomic-scale physical sys- 
tems, the effect of dissipation and the irreversible character of 
the measurements have all proved to be critical in feedback- 
design problems. The relevant dynamical models for both closed 
and open quantum systems are presented, along with the main 
results on their controllability and stability. A brief review of 
several currently available control design methods is meant to 
provide the interested reader with a roadmap for further studies. 

I. Introduction 

Quantum dynamical systems model the evolution charac- 
terizing physical phenomena at atomic scales. As the effective 
capabilities of manipulating matter and light at those scales 
is steadily growing and new experimental and technological 
possibilities are at reach, the interest in developing systematic 
theories for controlled quantum mechanical systems is rapidly 
increasing. In addition, the potential advantage offered by 
quantum information processing 1 1 1 has given to quantum 
control a new perspective, and a new set of tasks: the ability of 
employing quantum systems to store, manipulate and retrieve 
information requires an unprecedented degree of control, and 
further motivates the development of control schemes specif- 
ically tailored to the quantum mechanical setting. Since the 
time of the first pioneering contributions to the field [2], 0, 
[4 1, [5 1, quantum control methods have gained a stable role in 
a number of experimental settings, among which we recall: 
Laser-driven molecular reactions - Thanks to control-theoretic 
techniques (in particular optimal control), the design of laser 
fields able to induce selected molecular reactions has evolved 
from an heuristic to a systematic approach 0, 0, Q, 0. 
Optimal control in the context of reaction dynamics and other 
aspects of the problem are reviewed e.g. in [5], |9|, |10|. 
Pulse sequences design in Nuclear Magnetic Resonance 
(NMR) - In NMR spectroscopy, the system (an ensemble 
of atomic or nuclear spins) is typically steered by means 
of sequences of strong electromagnetic pulses ifTTIl . [12|, 
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lfl3ll . The bewildering range of open loop control methods 
developed in NMR over the last 60 years has, until only re- 
cently fl4l . lfl"5l . passed unnoticed by the control community. 
Alongside piecewise constant controls, these methods include 
also averaging techniques and "chattering" control ifTBI . 
Adaptive quantum measurements - the first type of closed-loop 
quantum control to be considered theoretically was motivated 
by the engineering of optimal detector for classical communi- 
cation over quantum media [17], [18|. Following those ideas, 
theoretically advanced adaptive measurement experiments also 
based on quantum feedback control experiments have been 
performed 1191 . GUll . ll2D . and this continues to be a very 
active research area. 

Feedback control of optical systems - Quantum-optical sys- 
tems and networks represent a natural platform to implement 
feedback control methods: a significant body of theoretical and 
experimental work has been developed since the early exper- 
imental and theoretical contributions on control of traveling- 
wave quantum fields El . G3l . 11241 . E51 . which were among 
the first quantum-limited feedback control experiments to be 
performed. A number of interesting, control oriented results 
have been concerned with control of simple systems trapped 
in optical cavities by designing a laser beam, with a focus on 
state preparation and cooling problems fl26l . Il27l . [28 1, [29|. 
We refer the reader to the monograph [ 30 1 for a comprehensive 
review, including historical perspectives, from the quantum 
optics viewpoint. 

Other systems for which control-theoretic methods are being 
successfully employed include quantum dots Bill . Il32l . opto- 
and nano-mechanical resonators [ 33 1, [34|, 11351 . trapped ions 
ll36ll , (37), J osephson- junctions ||38| . [39|, cold atoms |40|, 
1141 II and, recently, nitrogen-vacancy centers in diamonds [42|, 
ll43l . Discrete-time approaches to quantum measurements and 
feedback control have been also used for experiments on single 
photons B4l and spin ensembles [45|, [46|. 
Such a diverse range of applications makes it quite clear that 
an exhaustive introduction to the field of quantum control 
cannot arguably be condensed in the form of a tutorial paper. 
Engaged in this endeavor, we have inevitably been forced 
to face some difficult choices. We opted for a selection of 
topics that can be presented to a control engineering audience 
avoiding long technical detours, and that in part complement 
other introductory material available e.g. in 0, 11471 . |48|, 
1 30], [49|, 1 50], |8|. We chose not to describe any particular, 
physically-relevant example in detail, since each experimental 
system presents a number of particular features that cannot be 
thoroughly discussed in the limits of this work. In the spirit of 
systems and control theories, we would like instead to provide 
the reader with a set of theoretical tools that are as "portable" 
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(from an experimental setting to another) as possible. This of 
course comes with a cost: in order to move to applications, 
one has to carefully verify the applicability of the results, 
and most likely adapt them to the peculiarities of his/her own 
setting. The models we discuss are always continuous in time: 
this of course leaves out a significant number of interesting 
results, but allows for a more consistent presentation and, in 
our opinion, a closer connection to classical control theory. 

Some of the topics related to measurement and feedback 
could certainly be presented in a quantum probability frame- 
work in a more rigorous way, as it has been recently done 
by part of the quantum control community: nonetheless, this 
approach may appear intimidating to a newcomer to the field, 
rendering the connection with earlier results less direct, and 
it is not the most natural for investigating e.g. controllability 
issues. We therefore introduce and use notions directly stem- 
ming from it (as e.g. quantum conditional expectations) only 
when needed, and in a somewhat simplified manner, referring 
to the extensive literature for thorough expositions of these 
ideas. The emerging connections with (classical) stochastic 
models and control are highlighted when appropriate. 

The paper is structured as follows: The first part (Section 
[H||IV[ ) is intended as a concise tutorial on quantum controlled 
dynamical systems. More in detail, Section [II] presents the 
basic (static) tools for building a quantum system (states, 
observables and ways to compute probabilities), Section III 
introduces the dynamical models for isolated quantum systems 
and Hamiltonian control. In Section|lV]the reader is introduced 
to the three main approaches to the description of controlled 
open systems (in continuous time): Hamiltonian description, 
master equations and stochastic models. 

The second part is devoted to control-oriented issues. Sec- 
tion [V] guides the reader through the fundamental controllabil- 
ity analysis of the deterministic models. The rest of the paper 
(Section |VI|VII[ ) should serve as a brief survey of the wide 
spectrum of synthesis methods that have been presented in 
the literature, including both open- and closed-loop methods. 
The authors' perspective on the next challenges in the field is 
subsumed in Section [Villi 

II. Quantum essentials: 
Observables, States and Probabilities 

This section is devoted to present the basic elements of 
quantum theory for finite-dimensional systems. For more de- 
tails, and other modem approaches to quantum theory, we 
refer the reader to the monographs Bill . (52ll . (53l . To every 
quantum system Q is associated a complex Hilbert space T-L. 
The dimension of the Hilbert space depends on the variables of 
the system we aim to describe: here, for the sake of simplicity 
and in order to avoid technical complications, we will only 
consider finite-dimensional quantum systems Ti = Ti N ~ C , 
namely systems whose variable of interest can assume only a 
finite number of outcomes. Elementary examples are quantum 
models describing spin or polarization properties BP . Finite 
dimensional systems also allow for simple linear-algebraic 
representations, helping to establish explicit connections with 
classical system-theoretic methods, and are of key interest in 
the emerging field of quantum information (TJ. 



A. Observable quantities 

Any (real-valued) physical variable for the system, or 
observable in the physics terminology, is associated to an 
Hermitian operator Y G $)(H ). By the spectral theorem, 
Y admits a representation Y = J^jUj^j, where {yj} C M. 
are the eigenvalues of Y and the corresponding orthogonal 
projectors {LTj} form a resolution of the identity, namely 
n^H, = SkjHj, Ylj^j = The eigenvalues {yj} then 
represent the possible outcomes of a measurement of Y, and 
the , which play the role of quantum events, let us compute 
the corresponding probabilities, given the state of the system. 

To learn more about the non-commutative probability 
framework that encompasses quantum mechanics, see Remark 
1. For a thorough exposition, we refer to (54], or to the 
excellent introduction (55]. 

B. State vectors 

When the state of the system is (ideally) known exactly, it 
can be described by a state vector \ijj) (see Appendix |A| for 
a review of Dirac's notation). \tp) is a norm-1 vector in the 
complex N -dimensional Hilbert space Ti. 

A particular choice of basis is employed throughout this 
tutorial: consider the observable H = J2j e j^j e -£>C^) 
associated to the energy of the system, that is, the Hamiltonian 
of the system, and choose an orthonormal basis of eigenvectors 
of Hq, {|ei), . . . , |ejv)}- In this basis, we can represent Ho as 
a diagonal matrix: 



H =diag(e 1 ,...,e Ar )- 



(1) 



If we write the state vector of the system with respect to this 
basis, \ip) = C\\e\) + . . . + cjv|eAr), then 



N 
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1. 



(2) 



and \cj\ 2 is called the population of the j-th eigenstate. 
Geometrically, |2]) means that the state vector \ip) is living 
on the unit sphere on the Hilbert space Ti of dimension N: 

|V>) e s 2 ^- 1 c T-L. 

C. Density operators 

Density operators are used to describe the state of statistical 
ensembles i.e., collections of identical quantum systems, or of 
a single system in the presence of classical uncertainty. More 
precisely, assume that fj, j = 1, ...,m, is the fraction of 
population of some ensemble prepared in the state with 
different state vectors not necessarily orthogonal to each other. 
The associated quantum density operator is defined by 



s.t. /, > 0, 



fj = l- (3) 



While to every ensemble {fj, \ipj}} corresponds a unique p, 
the same density operator can emerge from different ensem- 
bles: for example, p = j^I can be obtained by any ensemble 
with fj = i Vj and {|^)} any orthonormal basis. A density 
operator can also be used to describe the state of a single 
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system prepared in an uncertain state, much alike a probability 
density in the classical (Bayesian) framework. In general, the 
density operator is a square complex matrix of dimension 
N x N such that 

l)p = pt>0; 2)tr(p) = l; 3)tr(p 2 )<l. 

Properties 1) and 2) are straightforward given ^ and invoking 
the linearity of the trace, while 3) is directly implied by 1) and 
2). The quantity tr (p 2 ) is called the purity of p. Call Q(H) 
the set of matrices satisfying l)-2) above: 

= { P e !B(«) | p = > 0, tr (p) = 1}. 

The structure of D(H) is not easy to describe: the constraint 
tr (p) = 1 makes the convex cone p = p^ > into a compact 
and convex set. We will see below that for N — 2 the structure 
of 53 (H) can be made explicit by means of the so-called 
Bloch vector representation. An important subset of density 
operators is the following: if /j = 1, the whole ensemble is 
prepared in the same state \ip), so that p = \ip)(ip\ is a rank- 
one orthogonal projector. Such a p is called a pure state. In this 
case, the description one obtains is completely equivalent to 
that provided by the state vector up to an irrelevant global 
phase (see below). On the other hand, an ensemble in which 
at least two of the fj of eq. ([3]) are nonzero is called a mixed 
ensemble, or mixed state and does not admit a description in 
terms of a single state vector. In matrix representation, it is 
always possible to apply a change of basis that diagonalizes 
p. Then we have p = diag(pi, . . . , pn), where pi, . . . p^ are 
the eigenvalues of p, pj > 0, j = 1, . . . N, YljLi P-j — !■ in 
particular, we have that, up to a permutation of the eigenvalues, 
for pure states: pi = 1, p% = ... = p^ = and hence 
tr (p 2 ) = 1; while for generic mixed states at least two 
eigenvalues are nonzero pi ^ 0, p 2 ^ and tr (p 2 ) < 1. The 
state with p\ = p 2 = ■ . ■ = pn = ■h is called the completely 
mixed state (or completely random state). It is characterized 
bytr(p 2 ) = i. 

D. Probabilities and expectations 

If the state of a system is described by \ip), the probability 
of obtaining yj as an outcome of Y = yjHj is computed 
as 



Pj = (^\ U J 



(4) 



Thus pj is real and positive, and such that J^jPj = 



= (ip\ip) = 1. The state vector, after a 



measurement outcome has been recorded, becomes 



m 3 w 



(5) 



where \ip\Y= Vj ) denotes the state vector conditioned on 
recording the outcome yj in a measurement of the observable 
Y. It is worth noticing that the global phase of the state vector 
does not carry physical information, that is \ip) and e l ^\ip) lead 
to the same predictions, according to |4|-(|5]), for any <f> £ K. 

For density operators, the prediction and conditioning rules 
(|4|-(|5]l, along with the fact that (ip\X\ip) = tr(|')/')(i/ ; |^) 
for any X G Sj('H N ), imply that for a pure state, given an 



observable Y = Y^j Vj^-ji tne probability of obtaining yj as 
an outcome of Y is computed as 



Pj = tr (p n i); 



(6) 



and the conditional density operator after the outcome yi has 
been recorded becomes 



P\Y = 



IljpUj 



11} 



(7) 



XxipRjY 

On mixed states |6| still holds by linearity, and the validity of 
(|7]i is extended to this generic case. 

Assuming that the state before the measurement is p, we 
want to compute the expectation value of an observable Y. 
Starting by the (classical) definition of expectation and using 
the linearity of the trace, we get that 
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VjPj 



j 



Hence, the expectation value of observables can be computed 
directly as the Hilbert-Schmidt inner product of Y and p. 

Let us remark that the conditioning rule |7]i directly leads 
to a remarkable difference between classical and quantum 
probability. In fact, suppose a measurement of Y has been 
performed, but no information on the outcome is available (a 
situation sometimes referred as non-selective measurement). 
Thus one can compute the "average" state: 

p = Y^PjP\Y=y 3 = X! U ,P U r 

3 j 

This is in general different from p, in striking contrast with 
the classical case. 

Remark 1 (Retrieving classical probability): Assume we 
fix an observable of interest with non-degenerate spectrum, 
say Y = Y2j=i S/jHj-, and consider only the other operators 
that commute with Y, [X, Y] = [p, Y] = 0. Thus in spectral 
form we have p = J^jPj^j^ X = J2j x j^j- Atvy valid 
event is associated to an orthogonal projection IT that can be 
written as II = ^jftjUj, with TVj E {0,1}. Then all these 
operators are completely specified by their spectra, which are 
functions from £1 = {1, . . . , N} to K. Let us now interpret 
il as an abstract sample space, and define the probability 
distribution F(us) = p u associated to the spectrum of p. The 
"classical" rules are then retrieved from the quantum ones: 
the probability of an event II can be computed through its 
spectrum ir, playing the role of the indicator function: 

N 

tr (pn) = ^ (Hj-n) pj = T^PM = P(n). 

j=i uieii 
Similarly, we can compute expectation values of observables 
interpreting their spectra as random variables: 

tr (pX) = Y x jPj = x u ¥(lj) = E(X). 
j 



Building on these ideas, one can rigorously "encode" a classi- 
cal probability space in a commutative algebra, and then obtain 
a quantum probability space by removing the commutativity 
constraint ll55ll . From this viewpoint, the quantum two-level 
system that we will detail in the next section can be thought 
as the non-commutative version of a classical coin. 
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E. Two-level systems and Block representation. 

A two-dimensional quantum system, with state vector g 
S 3 C H 2 , is also called a qubit, representing the quantum 
mechanical "unit" of information in analogy with the classical 
"bit" [1|. The orthonormal reference basis elements are typi- 
cally denoted as |0), |1) and we have the vector representation 



with | Co | 



\ip) = co|0)+ci|l) c 
| 2 = 1, i.e. E § 3 . The observables for 



a two-level system form the 4-dimensional real vector space 
S)(H 2 ). A convenient matrix basis for representing S)(H 2 ) is 
given by the Pauli matrices: 



ro 


i 




'0 -i 




1 " 


i — ■ 







i 




-1 



completed with a$ = 12- ff Ii}jZ are Hermitian, traceless, 
unitary and involutive (a 2 = 1%). 

In terms of the Pauli basis of S)(H 2 ), the density operator 
of a two-level system can be expressed as 



P = \(h + xa x + yo y + za z ), 



(8) 



where j = tr (pa j), j — x,y,z, are the expectation values 
along the observables a XyVtZ , and ^tr (pli) = 1 is a constant 
(expectation value along the "trivial" observable oo = I2) 
ensuring tr (p) = 1. We define the Block vector as 



x y 



A e 



Due to the extra constant coordinate, the Bloch vectors are 
in fact affine, and form a convex subset of an hyperplane in 
R 4 . The matrix (Hilbert-Schmidt) inner product on the space 
of Hermitian matrices induces the standard Euclidean inner 
product on R 4 (or R 3 for the linear part), indicated with 



If e, is the canonical basis element in 



tr (crjOfc) 



= 8jt 



~j,ek)) = S jk , V j, k = 0, x, y, z. 



Hence the Frobenius norm of p induces the standard Euclidean 
norm || • || for p: \\p\\ — -\/tr (p 2 ). The condition tr(p 2 ) < 1 
then translates in p-space as p belonging to the solid ball of 
radius 1. The surface ||p|| = 1 of such ball corresponds to pure 
states. On the Bloch ball, the ground state |0)(0| corresponds 
[0, 0, 1] T , the excited state |1)(1| to p = [0, 0, -1] T and 

|l)(l|top=[0,0,0] T . 



to p 

the completely mixed state ||0)(0|- 



F. Joint systems and entanglement 

Entanglement, its characterization, and its uses as a resource 
in communications and computing represent vast subfields in 
quantum information sciences: here we only aim to recall the 
basic definitions. Consider two quantum systems with associ- 
ated Hilbert spaces Ha,Hb respectively. The joint description 
is given in the tensor product space Hab = Ha ® Hb (see 
Appendix [A}. Observables on one of the subsystems, say 
Xa S $)(Ha) are then mapped to X = Xa <S> I ■ However, 
any Hermitian operator on Hab is a valid observable for the 
joint system. It is easy to see that there exist state vectors 
|V^) € Hab that do not admit a factorized representation, yet 



represent perfectly valid states for the compound. These states 
are called entangled. Consider e.g. two qubits, with Hilbert 
spaces T-Ia,Hb- Then one can directly prove that 

1 



V2 



(|o) ® |o) + |i) ® ^ \4> A ) ® 



for any choice of \i/ja) & Ha, \iPb) € Hb- If the two systems 
are well-identified and physically separated, this implies that 
the joint system can be in principle be prepared in a pure state 
which is intrinsically non local. 

In the density operator formalism, a state pab € 3? (Hab) 
is usually said to be entangled if it cannot be written as a 
classical mixture of factorized density operators, i.e. if 

PAB ^ ^PjPa® Pb> 
3 

with J2jPj = 1, P] > OVj and p\ G Q(Ha), Pb G ®(Hb). 

III. Dynamical models of closed quantum systems 

A. The Schrddinger equation 

The basic dynamical postulate of quantum dynamics is that 
the state vector \tp) of a closed system obeys the autonomous 
linear ODE 

=1^0), 



(9) 



called the Schrddinger equation for the state vector, where 
Hq is the Hamiltonian of the system. Hereafter the units are 
chosen, as customary, so as to fix the Plank constant h to 1. 

The real eigenvalues ej, j = 1,...,N of Hq are called 
the energy levels of the quantum system. Transformation of 
the energy levels by an additive constant only introduces in 
the state vector dynamics a global phase factor, which we 
already recognized to be physically irrelevant. To eliminate 
this ambiguity, it is customary to choose a traceless Hq: 
e\ + . . . + ejv = 0. We can assume that ej ^ if j ^ k, 
j, k € {1, ... , N}. The differences ej—e^, j, k € {1, ... , N}, 
are called the transition frequencies (or resonances, or Bohr 
frequencies). A system is said to be regular (or nondegenerate) 
if ej 7^ efc V j, k € {1, . . . ,N}, j ^ k, i.e., if its energy 
levels are all nondegenerate. A system is said strongly regular 
(or with no degenerate transition) if ej — 7^ eg — e m 
V j, k,£,me {1, ...,N},j^k,£^m, (j, k) £ (I, m), 
i.e., if its resonances are nondegenerate. 

The control of a quantum mechanical system is typically 
obtained by coupling it with one or more tunable electromag- 
netic fields. Perturbation theory can be used to derive a model 
for this quantum - external field interaction: in many physically 
relevant situations, and reasonable approximations, |56|, |48|, 
ll57ll . a semiclassical description is sufficient, i.e., the series 
expansion can be truncated at the first order terms, yielding 



I Wo)) =N>o>, 



2JV-1 



(10) 

where the driving Hamiltonians Hj = Hj contain the cou- 
plings between the energy levels of the free Hamiltonian Hq, 
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and uj, the amplitude of the interactions, represent our control 
parameters, Uj G [uj >m i n , Uj, max ] C M. A control entering 
the dynamics as in ( fTO) is sometimes called coherent, as it 
preserves the unitary evolution of the state vector (see below 
for a geometric explanation). To avoid conflict with other 



meaning of the term "coherent" (see Section VII-C I, we shall 
call the controls of ( |T0] > unitary. The system (|10[) is a bilinear 
control system on a sphere ||58ll . We shall see that one control 
function is generically sufficient to ensure controllability, and 
most of the results we present generalize in a straightforward 
way to the multi control setting. Hence, we consider from now 
on the simple case: 



\m) 



= -i(H + uH 1 )\i>) 
= Ho)- 



(11) 



B. Unitary propagator 

The complex sphere S 2 ^ -1 , representing pure states, is 
a homogeneous space of the Lie group U(N) = {U G 
GL(N,C) | UW = WU = 1} as well as of its proper 
subgroup SU(N) = U(N)/U(l), in which the global phase 
factor has been eliminated. The Schrodinger equation can 
therefore be lifted to the Lie group SU(N), obtaining in 
correspondence of ( fTT) the right invariant matrix ODE: 



U 

U(0) 



-i(H + uHi)U, U G SU(N) 



I. 



(12) 



called the Schrodinger equation for the unitary propagator. 
For the system | |12) , the total Hamiltonian H(t, u) = Hq + 
u(t)Hi is in general time-varying. The solution of ( fT2) > is 
therefore given by a formal, time-ordered exponential 



U(t) = Texp 



H(s, u)ds 



(13) 



which is called Dyson's series in the physics literature 
and is analogous to a Volterra series in control theory. 
Consequently, for (JTTJ we have: \ip(t)) = U(t)\ipo) = 
Texp (-i f*H(s,u)ds) \ip ). 

The Lie algebras of U(N) and SU(N) are, respectively, 
u(N) = {i e C NxN | A* = -A} and su(N) = {A G 
u(N) | tr(A) = 0}. u(N) and su(N) are semisimple compact 
Lie algebras, meaning that the corresponding Killing forms 
are negative definite 



C. Quantum Liouville-von Neumann equation 

Given a certain Hamiltonian H(t,u), in this Section we 
describe the time evolution of the density operator which 
corresponds to the Schrodinger equation of H(t, u). Since for 
any state vector \tpj) we have \ipj) = U(t)\ipj(0)), for the 
outer product |^>j)(^>j| we obtain 

\^(t)}(^(t)\ = u(t)\^(o))(^(o)\uHt), 

and similarly for any convex sum of \4'j)('4 , j\- l n terms of the 
unitary propagator ( fT3] l we thus have 

p(t) = U(t)p(0)U\t). (14) 



The infinitesimal version of ( fl4"| > is the quantum Liouville-von 
Neumann equation: 



P =-i[H(t,u), p] 
P(0) = Po- 



The main feature of this equation is that it generates isospec- 
tral evolutions i.e., 

sp(p(t)) = sp(p(0)) = *(p) = {/xi, • • ■ , Pn}- (16) 

A consequence of the isospectrality of ( fT5j ) is that the eigen- 
values $(p) form a complete set of constants of motion of 
( p~5| ). Hence H>(H) is foliated into (compact and connected) 
leaves uniquely determined by $(p). Call C G D(H) one 
such leaf and consider po G C. Then C corresponds to 
the orbit of SU(N) under the conjugation action passing 
through p : C = {Up W, U G SU(N)}. If the geometric 
multiplicities of the eigenvalues $(/»o) are given by j\, .. , 
ji + ■ ■ ■ + je = N, 2 ^ £ ^ N, then C is the homogeneous 
space 

C = U(N)/(U(j 1 )x...xU(j i )), 

with + . . .+je = N, 2 ^ £ ^ N. As we vary the eigenvalues 
Pi , . . . , pjy, the multiplicities ji , . . . , ji form a flag; the C are 
consequently called complex flag manifolds, see [60]. The flag 
determines also the (even) dimension of the manifolds C, call 
it m, which can vary from 2A^ — 2 in the case of pure state 
$ = {1, 0, ... ,0}, to iV 2 - N in the case of all different 
eigenvalues $ = A*2, • • • , Pn}, P 3 ^ Pi, J2jL% Po = l - 

Alternatively to {jui, • • • , Pn}, one can consider as a com- 
plete set of invariant quantities of the ODE ([15} the so-called 
symmetric functions i.e., the coefficients of the characteristic 
polynomial det (si — p) = or, equivalently, the quantities 
tr (p) , tr (p 2 ) , . . . , tr (p N )- See lloTl for a complete de- 
scription of the invariants of motion. 



D. Schrodinger 's and Heisenberg's dual pictures of dynamics 

In the previous sections we studied the evolution of states 
of closed quantum systems, which for density operators turns 
out to be given by the conjugate action ( fi4] i of the unitary 
propagator U(t) defined in ( fT3| ). Assume the state is p(t) = 
U(t)poW (t), and consider an observable Y = J2jVj^-j so 
that E p ( 4 )(y) = Xi(Yp(t)). By using the cyclic property of 
the trace, however, we can also write 

E pit) (Y) = tr(YU(t)p(0)tf(t)) = tx(UHt)YU(t)p(0)), 

so that by defining Y{t) = W (t)Y (0)U (t) , F(0) = Y, 
we get E p ( ( )(y) = K p fQ\(Y(t)). This shows how the same 
predictions on measurements can be obtained by assuming that 
the state is time invariant, and by letting the observable evolve 
according to conjugate action of the adjoint unitary operator. 
This corresponds exactly to the dual evolution with respect 
to the Hilbert-Schmidt product. Accordingly, the evolution 
equation for observables in this dual picture is 

Y = i{H(t,u),Y]. 

Throughout most of the paper, dynamics will affect the system 
state while leaving the observable variables time-invariant (the 
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so-called Schrodinger picture in the physics literature): we 
choose to adopt the view most commonly found in the existing 
literature. However, the dual (Heisenberg) picture is more 
natural at least in the framework of quantum probability, and 
we shall switch to it when describing quantum fields, quantum 
stochastic processes and feedback networks. 

E. Two-level system: Bloch equation 

The foliated structure of D(H) is not apparent from the 
invariants $(p). A way to obtain a better visualization, 
very effective in the case N = 2, is to use the Bloch 
vector parametrization. Any traceless Hamiltonian H(t) can 
be decomposed in terms of the Pauli matrices as H(t) = 
J2j= x y z hj(t)&j- From ([8]), also p can be expressed in terms 
of the (Tj matrices. Consider the Liouville equation ( fT5| ). Using 
the Bloch vector p, one gets along —icrf 



3 i 



P\ - BjP, 



(17) 



where (Bj) 



i)kt 



are the 3x3 skew-symmetric matrices of 
structure constants associated to the {— icr Xt y^ z } basis of su(2). 
Identifying as in ( fTTj ) a matrix commutator and a matrix-vector 
multiplication through the structure constants means passing 
to the adjoint representation of a Lie algebra. For su(2), the 
adjoint representation corresponds to the Lie algebra so (3). 



With respect to {— i 



' x,y,z 



}, a basis of so(3) is given by the 



following 3x3 skew-symmetric matrices: 








-1 







' 





1 




"0 





0" 


B x =2 


1 








,B y =2 











,B Z =2 








-1 















-1 













1 






(18) 



Hence 



i[H,p] = 



j=x,y,z 



j=x,y,z 



hjBjp = B H p 



and the Liouville - von Neumann matrix ODE ( fT5| becomes 
the following vector ODE, normally called the Bloch equation: 



B H p 



7 j 

j=x,y,z 



hjBjp. 



(19) 



The Bloch equation ( fT9| ) describes infinitesimal rotations of 
p. As such, ||p|| is a constant of motion. The time evolution 
of ( fT9| ) occurs therefore on a sphere of radius ||p|| = ||p(0)||, 
and indeed tr (p 2 ) is an invariant of motion. 

F. N -level system: explicit parametrizations 

For a iV-level system, the density operator has N 2 — 1 
degrees of freedom. Several explicit parametrizations are used 
in the literature to "vectorize" the matrix ODE dT3T>: 

• coherence vector, i.e., vector of expectation values with 
respect to a complete set of orthonormal traceless Her- 
mitian matrices (e.g. the A-dimensional Pauli matrices), 
see 1551: 

• superoperator representation, where the matrix state space 
is transformed into vector state space e.g. through the 
"vec" operation. This is refered to as Liouville space 
representation in the literature, see iTTTl . 



The explicit description of p in terms of these parametriza- 
tions is however much more complex than for the two-level 
case, see for example l62l . 

IV. Dynamical models for open quantum systems 

A. Hamiltonian description of open quantum systems 

Any model for a physical, realistic quantum system should 
in general take into account the interactions of the system of 
interest with its environment. The most general way to intro- 
duce open-system dynamics is via its Hamiltonian description: 
consider a finite-dimensional quantum system S, coupled to 
a quantum environment £ via some interaction Hamiltonian. 
We can in principle think of including in the environment any 
other system that interacts with the one of interest, making 
the compound system isolated. More precisely, let Hs and 
H £ denote the system and the environment Hilbert spaces, 
with dim('Hs) = N < oo. Assume that the dynamics of the 
joint system plus environment is driven by a time-independent 
Hamiltonian of the form 



H s ® h + Is ® H £ + H S£ , 



(20) 



where Hs , H £ , H$ £ are the system, environment, and inter- 
action Hamiltonians, respectively. On the joint Hilbert space 
Hs <3 Hs the dynamics is still unitary, and could be described 
along the lines of the former sections. 

B. Reduced states and the master equation approach 

In many situations, e.g. in order to limit the complexity 
of the description or because the degrees of freedom of the 
environment are not accessible, it is convenient to seek a 
reduced description, involving only the system S. This can 
be formally obtained by "averaging" over the environment 
degrees of freedom via the partial trace ll56l (see Appendix). 
Assume the initial state for the system-environment ODE is 
factorized, p Q <g) p £ , and define Use(t) = exp(—iH tot t); then 
one can define: 

p{t) = T m [po] = ti E (u S£ (t)(p ® Pe)ul £ {tj) . 

The resulting dynamics is in general non-Markovian, and 
an integro-differential equation for the reduced state can be 
formally derived by using the Nakajima-Zwanzig projection 
technique (57l . which typically involves a non-trivial memory 
kernel, and can be written in the form: 



d_ 
~dt 



Pit) 



IC(t,s)p(s)ds , p(t ) = p . (21) 



While control of non-Markovian dynamical systems has 
been considered, especially in the Hamiltonian picture (see 
Section [VI-C| >, most of the control-oriented literature has been 
concerned with the Markovian case, which has the enormous 
advantage of leading to dynamical equations in simple form. In 
fact, under proper assumptions on the memory time-scales of 
the environment, or by invoking the Born-Markov approxima- 
tion or another appropriate limiting procedure |56|, [57], [30|, 
in certain situations the family {77t )S )[-], t, s > 0} becomes 
actually time-homogeneous (Vt, T(t. s ) — T(t+ TtS + T ) —'■ Tt- S ) 
and satisfies the following properties: 



7 



1) Tt is linear and continuous for all t > 0, and maps 
33 (Ks) into itself; 

2) 7t is completely positive 11561 . (TJ, that is, Vt > 0, 
7t(/o) = J2k Mt,kpMl for some finite set of operators 
{M tik } c ^Hs); 

3) the forward composition law holds: % ° 7^ = 7t+ s - 
l)-2) are physically motivated (and hold for general T(t, s )), 
while 3) is satisfied in a significant variety of situations, e.g. 
in many quantum optical systems ll63l . Il64ll or whenever the 
memory effect of the environment can be neglected l57l . In 
this cases the state dynamics are described by a Markovian 
Quantum Dynamical Semigroup (QDS) [56|. It has been 
proved [65|, |66| that the generator for a QDS is a Markovian 
Master Equation (MME) of the form: 

d -o(t) = £(p(t)) = -i[H, P (t)} + C D (p(t)) (22) 



df 



-i[H,p(t)] 



N*-l 

E 

k.l 



, a kl (\ k p(t)\j - *{A[,A„ p(t)}) 



with {\j}j=i ...,n 2 -i a complete orthonormal set of traceless 
N x N Hermitian matrices, for example the /Y-dimensional 
Pauli matrices, or the so-called Gell-Mann matrices [56|. 
The effective Hamiltonian H is in general equal to the free 
system Hamiltonian H$ plus some correction induced by the 
interaction with the environment (Lamb shift). The positive 
semi-definite A = (a k i) is called GKS (Gorini-Kossakowski- 
Sudarshan) matrix and fully specifies the dissipative part of the 
generator weighting the non-Hamiltonian terms X k p(t)\] — 
|{a£Az, p(t)}. The MME (f22| is a linear (or bilinear when 
control is present) matrix ODE, and the resulting dynamics is 
in general non-unitary. A generator ( |22] i is said to be unital 
when £(In) = 0, and hence the completely mixed state 
In/N is stationary. Thanks to the Hermitian character of A, 
by choosing a different operator basis, Eq. ([22} can be put in a 
symmetrized form, also known as Lindblad form or Lindblad 
master equation: 

j t p(t) = -i[H,p(t)]+Y,V(L k ,p(t)) (23) 

1 



[H,p(t)\ +J2L k p(t)L{ - -{L\L k , p{t)} 



In many situations, it is reasonable (and convenient) to assume 
a MME in Lindblad form on a phenomenological basis |56|. 
The L k s are also called noise operators, or noise channels. 
In this way, however, the separation between the Hamiltonian 
and the dissipative part is not unique due to the loss of the 
trace and orthogonality constraints on the L k s. 

C. Stability of the MME 

While unitary dynamics necessarily correspond to gen- 
erators with eigenvalues on the imaginary axis, the non- 
unitary terms in the MME introduce eigenvalues in the left 
complex half-plane. This motivates the study of the stability 
of the autonomous MME, a necessary first step towards the 
development of control strategies aiming at the preparation of 
desired states. 



Let us briefly recall some basic definitions and explore some 
stability features of the class of MME under scrutiny. A set M 
is invariant for ( |23| ) if for any p E M, its trajectory %(po) € 
M for all t > 0. Define a distance between a state and a set 
by d(p,M) :=inf CT6A < ||/>-<r||i, where \\X\h = tr(V^tX) 
is the trace norm. Then we say that M is (marginally) stable 
if it is invariant and for every e > there exists <5 such that 
if d(p ,M) < 6 then d(T t (p ),M) < e for all t > 0; M is 
Globally Asymptotically Stable (GAS) if it is stable and for any 
initial condition p € £>(%), lim t _j. +00 d(Tt(po),M) = 0. 

In our case, while L is indeed linear in p, the state manifold 
is the convex, compact set £>(%), hence overall we have a 
nonlinear system. Since 1)(H) contains a basis for the space of 
Hermitian operators, the action of C can then be extended (by 
linearity) to the real vector space $)(H). Thus, any matricial 
representation of such a generator on S) over the real field 
admits a real Jordan canonical form. This implies that it admits 
either real or pairs of complex-conjugate eigenvalues. 

Since C generates a semigroup of contractions in trace 
norm, {Tt — e ct } [56 1, [1], its eigenvalues must lay in the 
left complex half-plane. This implies that if a set is invariant, 
then it is also marginally stable. We shall thus focus on global 
asymptotic stability of equilibria. Since Tt maps the compact 
set T>(H) into itself, by Brower's fixed point theorem [67 1, the 
semigroup must admit at least one invariant state p e £ 
and p e must be in the kernel of C. The following Theorem 
from [68 1 ensures that there do not exist isolated centers. 

Theorem 1: A steady state of ( f23| is GAS if and only if it 
is unique. 

In many cases, however, the invariant sets are more com- 
plex. The case of invariant subsystems has been treated in 
|69l , ll70ll . while a decomposition of the Hilbert space that 
highlights the structure of attractive sets has been derived 
in ETJ - We recall here a linear-algebraic approach to the 
stability of subspaces. Consider a decomposition of the Hilbert 
space % := Hs © Hr. Let and { | r ^ ) } be orthonormal 

bases for Hs and "Hr, respectively. The (ordered) basis 
{|si), . . . \s m ), |n), . . . , \r n - m )} induces the following block 
structure on the matrix representation of an arbitrary operator 

Xs Xp 
ATq Xr 

Let us define the support of an operator as supp (X) 
ker(X)- L , and the set of states with support on Hs as: 

0" 



X 



(24) 



M s = {peV(H) 



P 



Ps 








, p s e2(H s )}, 



Vpo € Ms, t > 0, TM e Ms- 

As a first step, we would like to characterize the generators 
that render a certain subspace invariant for the evolution. 

Lemma 1: Assume that T~L = Hs © Hr, and let H, {L k } 
be the Hamiltonian and the noise operators in ( |23| l. Then, Ms 
is invariant iff Vfc 



L k = 



Ls,k 


Lp^ k 





^R,k 



iHi 



(25) 



Lp,k — 0. 
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Given that an invariant set is automatically marginally stable, 
it is possible to show (via LaSalle invariance principle) that 
Aig is GAS if and only if there is no invariant subspace with 
support on T~Lr. Refined or slightly different formulations of 
this result have been derived in 116911 . [68]. 



D. Two-level MME in Block vector representation 

While the commutator (Lie bracket) is linear for the basis 
elements cr x ,y,zt the anticommutator has an affine structure: 
{cry, <j k } — (3SjkI + ^,£—1 d e j k (j£, with dj k a real and fully 
symmetric tensor and f3 a normalization constant. From this 
property, it follows that in terms of the Bloch vector p the 
non-unitary part of |22) is in general an affine vector field. 
Therefore the MME ( p2| i becomes an inhomogeneous vector 
ODE 



p = B H p + ^ a jk (PjkP - 



9jk) 



(26) 



where the 3x3 symmetric matrices Tj k and the vectors gj k 
are functions of the structure constants c* + and see ll72ll 
for details. The vectors gj k constitute the inhomogeneous part 
of the Lindbladian action. When gj k ^ for some j, k, then 
the origin of the Bloch ball cannot be a fixed point. Hence in 
terms of p, unital Lidbladians correspond to linear (instead of 
affine) dissipation generators. 

Example 1 (Two-level system with unital dissipation): 
Assume the g,j k = in p6*| ) and call T — Y2j k=i a jk^jk- As 
soon as T is invertible, the only fixed point admissible in ( f2"6"| ) 
is the origin of the Bloch ball, p = 0, i.e., the completely 
mixed state p = and from Theorem [T] it is GAS. A 

common example for unital dissipation is the following 



r = - 



7i 



72 



73 



.9 = 



(27) 



with 7^ ^ 0. Several standard (discrete-time) noise channels 
used in quantum information, such as the bit flip, bit-phase 
flip and the phase flip, can be described in continuous-time 
by infinitesimal generators of the type ( p7| . For example, the 
phase flip channel squeezes the Bloch sphere along the x and y 
axis, leaving z unchanged: the equivalent effect in continuous 
time, or dephasing, can be generated by ( |27] i with 71 , 72 7^ 0, 
73 = 0. In this case the entire z axis of the Bloch ball is a set 
of fixed points for the system when u = 0. 

Example 2 (Two-level atom with decay): Consider a two- 
level atom, with ground and excited states denoted by |0), |1), 
respectively. Assume there is an average, observed rate of 
decay from the excited to the ground state equal to 7, i.e., if 
the state is initially in |1), the probability of finding it in the 
same state at time t is e -7 *. Assuming Markovian dynamics 
and using the ladder operators a± — \{cr x ± ia y ), one is led 
to a generator of the form (see e.g. (T), Sec. 8.4.1): 

p = -i[Aa z ,p] + 7 (v+po- - i{<7_er + , p} j , (28) 

with Acr z the system Hamiltonian (with trace normalized to 
zero), and 0+ the noise operator associated to the decay 
channel (c_ = crt). In fact, if one computes the probability 



pi(t) = tr(n 1( o(t)), with IIi = 
p(t) = IIi, indeed one gets pi(t) — 



with initial state 
"T*. In terms of d26l: 



1 



.9 = 7 



(29) 



E. Quantum stochastic models 

For open-loop control, we introduced a controlled 
Schrodinger equation in which the field action is modeled 
as a semiclassical perturbation of the system Hamiltonian. 
Performing measurements on light fields that have interacted 
with a system is also a common way of acquiring information 
about its state: however, to model this we shall resort to a fully 
quantum description of the Electro-Magnetic (EM) field. The 
next subsections will sketch the key ingredients of a model 
for this class of open systems. We anticipate that, while not 
every quantum control system is properly (or conveniently) 
described in this framework, these models present at least 
two advantages: (i) Under suitable (Markovian) assumptions, 
the interaction presents a natural input-output structure, that 
lends itself to the study and design of interconnections, with 
localized systems, beam splitters and optical elements as 
blocks, and traveling fields as signals; and (ii) the same 
formalism can be used for both the case of monitored outgoing 
fields, and the case of a unitarily evolving quantum network. 

These topics can be approached from many directions, and 
using different mathematical tools: see e.g. l73l . 11741 . (75 1 for 
thorough treatment of the field input-output formalism, |76|, 
113011 for models and applications to quantum measurements 
of light, [54 1, [55] for a quantum probabilistic approach to 
quantum stochastic processes, 11771 . Il78l for derivation of the 
quantum filters. 

1) Electromagnetic field and quantum stochastic processes: 
A general quantized EM field traveling along the z axis can 
be thought as a collection of quantum harmonic oscillators, 
each of these corresponding to a mode of the field at a given 
frequency, see Appendix [B] Under proper assumptions, the 
quantum vector potential and the electric field propagating 
along 2, and with frequency content concentrated at a given 
cj, can be described as linear combinations of b(z,t) and 
b'(z,t), namely the annihilation and creation operators for 
the mode of frequency oj at position z and time t. These field 
operators satisfy the commutation relation [b(z, t), b^(z, t')] = 
5(t — t')I, where 5 is the Dirac delta function, generalizing 
the harmonic-oscillator case to a traveling field. The operator 
valued processes b(z,t),w(z,t) are thus remarkably singular, 
and they play the role of stochastic processes in the quantum 
domain lf54ll . IP771 . Let us skip what would be a rather technical 
detour, and just mention that a proper white noise theory and 
Ito calculus can be developed: we will recall here the basic 
definitions and rules on the manipulations of these operator 
valued processes. 

We shall first focus on the description of the field right 
before it interacts with the system, that we assumed localized 
at z = 0, and hence at z = 0~. Define 

B in (t)= f b(0-,s)ds, A in (t)= f b\Q-,s)b(0-,s)ds. 
Jo Jv 
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It can be shown that dAj„(t) is the quantum equivalent of 
a classical Poisson process, and it is diagonal in the number 
basis {|t/>„)}. Furthermore, the self adjoint field quadratures 
dBi n +dBj n , —i(dBi n — dBj n ) both correspond (in their diag- 
onal basis) to classical Wiener processes, but do not commute. 
These operators act on a (infinite-dimensional) continuous 
tensor product of Hilbert spaces, called the Fock space 1731 . 
denoted Hp. Assume the input field is in the vacuum state, 
that is po = \ipo)(ipo\, where j^o) is the zero eigenvalue of 
Ki n . The following multiplication rules (non-commutative Ito 
table) can be used for calculus with the fundamental processes 
we just introduced: 

dB in {t)dB\ n {t) = Idt, 
dB\ n (t)dB ln {t) = dB ln {t)dB m {t) = dB\ n {t)dB\ n {t) = 0, 
dA in (t)dA in (t) = dA m (t), 
dA m (t)dBj n {t) = dB\ n {t), dB m (t)dA m (t) = dB m {t). 

These rules must be modified in order to apply to different 
input field states 11741 . It is worth remarking that a stochastic 
calculus has also been developed for fermion fields 11791 . These 
non-commutative stochastic processes are the cornerstones for 
constructing the model of the system-field joint dynamics, 
which we shall introduce next. 

2) Joint evolution and Heisenberg dynamics: We now have 
all the ingredients to describe the dynamical interaction of the 
free field with the system. The joint dynamics on Hs ®Hf, 
assuming that no other interaction affects either subsystem, 
is unitary and in general governed by a Quantum Stochastic 
Differential Equation (QSDE) of the form: 

dU{t) = ({S - I) ® dA in (t) + L ® dBjjt) (30) 

-tfS ® dB in {t) - ((iH + \l ] L) ® I)dtj U(t), 

with U(0) = I, H the free Hamiltonian of the system, and 
L, S in our setting are bounded system operators specifying 
the interaction of the system with the field, with S unitary. 

In terms of the solution U(t) of |30} one can now find the 
Heisenberg-picture dynamics for the system operators and the 
field processes. For an initial condition X(0) = Xq ® I, the 
evolution is simply X(t) = W (t)X(0)U(t), and the output 
field operator is B out {t) = W(t)I <g> B in (t)U(t). Using this 
notation also for the S, L operators, the stochastic differential 
equation for the input-output relation takes the simple form: 

dB out (t) = S(t)dB m {t) + L{t)dt. (31) 

3) Conditional expectation, homodyne detection measure- 
ment and filtering equations: From the framework we out- 
lined above, it is possible to rigorously derive equations for 
the system operators and state dynamics conditioned on the 
measurement outcome. To begin with, we need to introduce 
quantum conditional expectations. Consider a state p, an oper- 
ator X(t), and a self-adjoint family (process) {Y(s)} se [o,ti} 
on -H s ®H Fl such that [Y(r),Y(s)] = for all r, s G [0,'i]. 
{Y(t)} is then called self-nondemolition, and it generates a 
commutative (von Neumann) operator algebra y 11771 . Let y' 
denote the set of observables that commute with any Y G y, 



that is the commutant of y. A conditional expectation of X(t) 
with respect to the observations of a process Y(t) up to time 
t, is defined as an operator X(t) — n t (X) G y' such that for 
all Z G y' E p (X(t)Z) = E p {X(t)Z). This is equivalent to a 
least-square estimation of the operator, and can be interpreted 
geometrically as the orthogonal projection of X onto y 1771 . 

Let us illustrate the key steps of the derivation of the general 
filtering equation in a physically relevant case. Assume in fact 
we are monitoring the quadrature process Y(t) — B out (t) + 
B\ ut (t) and that for our system S — I. By using pi) , we 
have that Y(t) has differential 

dY(t) = (L(t) + L\t))dt + dB m (t) + dB\ n {t). (32) 

In this setting, the differential for a general system operator 
takes the form 

dX(t) = C^(X(t))dt+dBj n [X(t),L(t)] + [L^(t),X(t)]dB in (t), 

where tf(X) = i[H, X] + L^XL - \{L^L, X} is the adjoint 
of a MME generator in Lindblad form. This process can 
be used as a (at least approximate) model for experimental 
homodyne detection of the outgoing field. We also assume, for 
the sake of simplicity, that the photodetectors employed in the 
monitoring have efficiency one, but the models can be easily 
adapted to limited detection capability. It is easy to show that 
Y(t) satisfies the two properties: (i) [Y(t),Y(s)] = at all 
times s,t, and (ii) [X(t),Y(s)} = for all the observables on 
the systems X(t) = J7(t) t (A ® I)U(t). Property (i) ensures 
that the output signal is equivalent to a classical stochastic 
process, and with property (ii) it also guarantees that the 
conditional expectation for any system operators does exist. 
Thus, it is possible to derive a stochastic differential equation 
for the conditional expectation, namely the quantum filter |78 1; 

dn t (X) = n(^(X))dt (33) 
+ (n t {XL + L^X) -n(L + L^)n t {X)^dW{t), 

where dW(t) = dY(t) — ir t (L + U)dt is the innovation 
process. It can be shown by the spectral theorem (see e.g. 
1771) that for filters in this form the operator-valued innovation 
process can be substituted by a real-valued, classical Wiener 
process. 

Conditional dynamics in the Schrodinger picture can be 
derived by defining the conditional state p t G 35 (Hg), as the 
system density operator such that E Pt (X) = ~E p (X(t)). From 
this relation and ( |33| l, one can derive the quantum filtering or 
Stochastic Master Equation (SME) flTjO in Ito form: 

d Pt = {-i\H, p] + V(L, Pt )) dt + Q(L, pt)dW t , (34) 

where 

V(L,p) = Lptf- ±(lSLp + ptfL), 

G(L, p) = (Lp + ptf - tr ((L + Lt)p) p) 

are respectively the drift and diffusion parts introduced by the 
measurement of the field quadrature. Here {pt}, the solution 
of p4] ) given an initial condition p , exists, is unique, adapted 
to the filtration (£ t generated by the (classical) white noise 
Wt, and it is 35(H) -invariant by construction, see lf78l . [29|. 
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It is indeed possible to rewrite ([34} in terms of the coherence 
vector, obtaining a standard non-linear diffusion. 

Example 3 (Filtering equation for a two-level system): 
Consider a 2-level system interacting with an electromagnetic 
field along the z-axis 1 80 1 . Assume the system Hamiltonian 
is H(t) — Aa z , where A is a real parameter, and that 
the only interaction of the system is with a traveling field 
as described above. The outgoing field is monitored via 
homodyne detection, and the corresponding SME is 



case) and the associated semigroup generator by averaging 
over the Martingale part. 



dp t = - i[Aa Zl p t ]dt + v(a z p t a z - p t )dt 

+ Vv(<JzPt + Pt°z - 2tr (<j z p t )pt) dW t , 



(36) 



where v is a parameter representing the measurement strength, 
and dW t is the innovation process associated to the measure- 
ment record 

dW t = dY t - 2u{a zPt )dt. (37) 



This equation is of the form ( |34| i with H = Aa z , L = \Jva z . 
If we rewrite the dynamics in terms of the Bloch vector as in 
(|8), we get: 

dx t = {-Ay t - \vx t ) dt - \Jv x t z t dW t 

dy t = (Ax t - \vyt) dt - ^/vy t z t dW t (38) 

dz t =y/H{l- Z 2 t )dW t . 

This is a nonlinear diffusion in the closed unit ball of K 3 . 
It is easy to verify that there are two equilibrium points for 
the uncontrolled dynamics: for both [x,y, z] T — [0,0, 1] T , 
and [x,y, z] T = [0,0, —1] T , we have dx = dy = dz = 0. 
These states correspond to the eigenstates of the measurement 
operator a z . By direct computation ll29l it is possible to show 
that the variance of the observable a z , Vt(pt) = tr(o^Pf) — 
\x 2 ((j z p t ) > 0, represents a stochastic Lyapunov function for 
the system in the sense of [81 1, and that all the trajectories 
converge in probability to the equilibrium states. From a 
physics viewpoint, the free dynamics of a system like ( |3~8"j ) 
asymptotically replicate the effect of a projective measurement, 
with the correct probabilities of "collapsing" on the eigenstates 
of a z induced by the initial state (82), ||29t 

Remark 2 (Classical and quantum correspondences): 
Notice how p4| i is equivalent to a semigroup generator in 
Lindblad form plus a nonlinear, stochastic term accounting 
for the state update due to the innovation in the measurement 
record. It plays the role, in this non-commutative context, of 
the classical Kushner-Stratonovich equation |83|. Because the 
stochastic term is a martingale, the average over the noise 
trajectories leaves us with a MME in the form p3) , which 
plays the role of the classical Fokker-Plank equation. Of 
course, one can derive the generator by directly taking the 
expectation over the noise trajectory on the state equation, 
which makes sense in particular when no observation on 
the system is available. These correspondences are depicted 
in Fig. [T] with reference to the quantum models emerging 
from the homodyne-detection scheme. In fact, in the classical 
setting the filtering equation for a stochastic system is derived 
by conditioning on the past history of its output (represented 
by yt, which is a cr-algebra in the classical case and an 
equivalent commutative von Neumann algebra in the quantum 
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Fig. 1. A parallel between the models of classical and quantum stochastic 
dynamics, and the role of expectations. Adapted from |84|. 



V. Controllability of Quantum Systems 

Control systems such as the Schrodinger equation or the 
MME, driven by unitary controls, are bilinear control systems. 
A wealth of results is available to characterize the controllabil- 
ity properties of these systems, see e.g. (59 1 for a survey and 
[3 1 for an early application to quantum control. In this Section 
these results are applied to both closed and open quantum 
systems. 

A. Controllability of the Schrodinger equation 

For a system like (JTTJ, the reachable set from |^o) at ti me 
t is defined as 

K 



(\^o),t)^{\m)e§ 2N - i \3u(-) 



s.t. 



\4,(t))=Texp(^j -iiHo + u^H^ds) |Vo>}- 

In an analogous fashion, lZ(\ip ), ^ T) = {J 0<t<T TZ(\ipo), t) 
and Wo))=Uoa<ooWo>,t). 

The system ( fTl) is called (globally) controllable at [V'o) 
if ft(|V>o)) = § 2Ar ~\ and Small-Time Locally Controllable 
(STLC) if |V>o> e int(ft(|V'o),< *)) Vi > 0. Analogous defi- 
nitions hold for the unitary propagator U. Denoting TZu(') the 
corresponding reachable sets, the property of right invariance 
of ( flZ} implies invariance of the group-evaluated reachable 
sets: Ku(U ) = Ku(I)U VC/ G SU(N). A remarkable 
feature of compact Lie algebras is that the controllability 
properties admit an infinitesimal characterization. For SU(N) 
in particular we have the following theorem, originally due 
to (85). Denote Lie{^4, B} the Lie algebra generated by the 
matrices A and B. 

Theorem 2: The system ( fT~2] > is controllable iff 
Lie{-iH , -iH 1 }=su(N). 
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For general nonlinear systems, the Lie Algebraic Rank Con- 
dition (LARC) of Theorem [2] is characterizing only the acces- 
sibility property, i.e., whether the smallest Lie algebra spanned 
by the vector fields of the system coincides (locally) with 
the entire tangent space of the system. For a Lie group like 
SU(N), however, due to its compactness, the free Hamiltonian 
— iHg is not an "obstacle" to controllability for sufficiently 
long times, although a system like ( fT2| > fails to be STLC. This 
result provides a sufficient condition for the controllability of 
the Schrodinger equation. In fact, since the action of SU(N) 
on § 2jv_1 is transitive, we know from the theory of bilinear 
control systems |86|, |59] that the controllability of the system 
lifted to the Lie group ( fTZfr implies the controllability of 
(jTTJ on the corresponding homogeneous space. The condition 
is sufficient ("operator controllability" implies "pure state 
controllability" in the language of [87 1) but not necessary. In 
fact, there exist cases in which Lie{— iHo, —iH\} C su(N) 
but the corresponding reachable set TZu still acts transitively 
on the sphere S 2Ar_1 , see [87| for details. Owing to the 
semisimple nature of the Lie algebras involved, these cases 
are however rare. In fact, in semisimple Lie algebras we have 
the following generic result. 

Theorem 3: ( llSST ) The set of pairs A, B € su(N) for 
which Lie{j4, B} = su(N) is open and dense in su(N). 
Putting together Theorems [2] and [3] we have genericity of con- 
trollability on SU(N) and hence on § 27V_1 due to transitivity 
(89). 

Corollary 1: The system ( fTTj ) is controllable for almost all 
pairs H and Hi. 

As was first observed in |90l . Corollary [T] is the infinitesimal 
counterpart of the following quantum information result, valid 
for (nonlocal) quantum "gates", i.e., discrete-time unitary 
operators such as Uq = cxp(—iH T) and U\ = cxp(—i(H + 
u\H\)t) for some given r and u\. 

Theorem 4: ( 19"T1 ) Almost any pair of unitary gates Uq and 
Ui is universal. 

In the quantum information literature "universal" is used as a 
synonymous of operator controllability. Thm. [4] says that by 
composing arbitrarily many times the unitaries Uq and Ui it 
is almost always possible to reach any point of SU(N), i.e., 
TZu(I) = SU(N). Controllability of |V>) then follows from 
transitivity of SU(N) on S 2JV_1 . 

Example 4 (Two-level system): For € H 2 , in the en- 
ergy eigenvector basis, up to a scalar, the free Hamiltonian is 
of the form Hq = A<r z , with A a scalar parameter. A typical 
control Hamiltonian is Hi = cr x , which enables transitions 
between the two energy levels. Controllability is then ensured, 
since the first commutator yields [— iAa z , — ia x ] — —i2Aa y , 
and {—i(J x ,y,z} generate the full Lie algebra su(2). 

A particular feature of a semisimple Lie algebra such as 
su(N) is that the Lie brackets never vanish as we increase the 
level of bracketing. Hence the verification of Theorem [2] by 
brute force calculations becomes rapidly cumbersome. Alter- 
native, easy-to-check sufficient conditions for controllability 
can be given for particular families of generators 11921 . [93|. 
Consider again the basis in which H diagonal: in this basis, 
in fact, the control Hamiltonian Hi contains the couplings 
between the energy levels Bj of the system. The graph Qh ± 



associated to Hi = [by], is the pair Qh 1 = (A/^, Affi) where 
Mhx = {1) • • • > n} are the nodes and Ah x = {(i, j) \ hj 0} 
the directed edges connecting the nodes. Qh 1 is said (strongly) 
connected if for all pairs of nodes in Nh-l there exists a 
(directed) path in Ah x connecting them. If Hq is diagonal, 
a necessary condition for controllability of ( fTTj ) is that Qn 1 
be connected. In fact, if Qh x is not connected, there exist 
nontrivial invariant subspaces of su(N) that are simultane- 
ously iJo-invariant and i?i-invariant. Thus the system cannot 
be controllable. Physically, the connectivity of Qjj 1 means 
that it is in principle possible to transfer population from 
any energy level ej to any other e k . When the system has 
degenerate transitions (i.e., it is not strongly regular), however, 
not all population transfers may be possible, because different 
transitions may be excited by the same control field, meaning 
that controllability may be lost. The following Theorem, 
inspired by the literature on geometric control of systems on 
semisimple Lie groups [94], provides sufficient conditions for 
controllability. 

Theorem 5: ( l92l . Il93l ) If Hq is strongly regular and Qn x 
is connected then the system (jTTJ is controllable. 
Since both strong regularity of H and connectivity of Qh x 
are valid in an open and dense set of generators of su(N), 
Theorem|5]is generically verified. The condition of Theorem[5] 
is not necessary and can be weakened in several ways [93 1. 
For example, one can ask for the Bohr frequencies to be all 
different only on the graph of Hi, or, alternatively, that the 
graph of Hi remains connected when restricted to the set of 
arcs (j, k) that correspond to all different Bohr frequencies 
ej - e k . 

The extension of these results to the Liouville - von Neu- 
mann equation is straightforward. In ( fl5) , if p(0) £ C then 
p(t) G C Vt ^ 0, and the reachable set of the bilinear 
control system is at most C. Since C are homogeneous spaces 
of SU(N), controllability results analogous to those for the 
Schrodinger's equation hold. 

B. Controllability of the MME 

The main feature of the MME is to capture all the pos- 
sible time-invariant infinitesimal generators that leave 1)(H) 
invariant for the evolution. Under proper assumptions on the 
interaction with the environment [56 1, one can add Hamilto- 
nian controls to ( f23| >, obtaining 

j t p{t) - -i{H, p(t)} - i J2 u k [H k ,p{t)] + V ( L k, Pi*))- 

k k 

(39) 

The dissipation term Co — ^2i k D{L k , piff) is not unitary, 
hence the evolution of the MME ([39]) is no longer invariant 
on a complex flag manifold C and no longer isospectral. 
Correspondingly, the Lie (semi)group acting on p for the MME 
must be larger than SU(N). In particular, when Cd is not 
unital the integral group in which the QDS ([39]) is "sitting" 
must act in an affine way on p. Infinitesimally, affine actions 
are more easily characterized using vectors of coherences and 
adjoint representations, as in ( |26] i. A Lie algebra q acting 
affinely on a vector space is said to have a semidirect sum 
structure, g = Qi®V, where gi is a linear (homogeneous) 
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Lie algebra and V a vector space M95I . When instead Cd is 
unital, then the non-homogeneous part of g is absent: fl = 0i. 
Computing accessibility for an iV-level system, for example, 
is a matter of verifying which of the Lie algebras g are 
acting transitively on IR^" -1 (N 2 — 1 is the dimension of 
the coherence vector), see ll72l . 11961 . We report here the main 
result of ll72ll . where an analysis of controllability is developed 
in detail. 

Theorem 6: The system ( [39] l is 

1) accessible for g = flI(n,M) or g = gt(n, R)®R n ; 

2) never STLC; 

3) never controllable in finite time; 

4) never controllable in 33 ("H) for Cd unital. 

The lack of small-time controllability follows from the fact that 
the flow of ( |39] l contains directions, infinitesimally described 
by Cd, which are not unitary, hence cannot be reversed by 
means of unitary controls. Therefore, even under arbitrary 
unitary control, the infinitesimal object generated by the 
vector fields is only a Lie wedge (roughly speaking, a non- 
pointed cone, see |97|), and the corresponding reachable sets 
^G°(0)> < t) form only a Lie semigroup. While STLC is 
missing for any Cd, the two cases of unital and "affine" Cd 
are characterized by different properties for long times. In 
particular, for C d unital the reachable sets and the eigenvalues 
of p can be completely characterized in terms of monotonicity 
properties J72|, J98). If mj, i = 1, 2, j = 1, . . . N are the 
eigenvalues of p(ti) sorted in decreasing order, then let the 
symbol "-<" denote majorization: M2,j < 52j=i 

k = 1, . . . ,N - 1, with equality for k = N, see |98|. 



Proposition 1: If the system ( |39| ) is accessible and if Cd 
is unital, then 

1) ft(p(0), < h) D ft(p(0), < h) Vi 2 > h > 0; 

2) *(p(t 2 )) -< *(p(*i)) Vt 2 >ti. 

Together Theorem [TJ and Proposition [T] provide a complete 
characterization of the contraction behavior of p towards the 
steady state p — I/N when this is unique and Cd is unital. 

Example 5 (Two-level system with Cd unital): For any Hq 
and Hi such that Lie(— iHo, —iH\) = su(2), and T such that 
r invertible, Y not proportional to /, tr (Y) 7^ 0, the undriven 
system has p = as a globally asymptotically stable attractor. 
The Lie algebra is g = Lie(i?^f +Y, B^^) — gt(3, K) and the 
system is accessible. The reachable sets are lZ(p(0)) = {p € 
E 3 s.t. ||p|| ^ ||p(0)||}, i.e., the solid balls of radius equal to 
the initial condition. In this case the purity ||p|| 2 is a quadratic 
Lyapunov function centered in the completely random state 
also for the controlled system. 

Example 6 (Two-level atom with decay): As the unital part 
of Cd (i.e., Y in |29|) is invertible, the system ( f28) has a 
unique fixed point and it is a globally asymptotically stable 
equilibrium for the uncontrolled MME, see Theorem [T] The 
fixed point is pf = (Bh +Y) 1 g, which is the pure state 
Pf = |1) (1| m absence of controls. Constant non-zero coherent 
controls can be used to modify pf, but the equilibrium 
becomes a mixed state. A global order in the reachable sets, 
similar to Proposition [T] cannot in general be established, see 
IT721 . (99) for examples. 



VI. Synthesis methods for open-loop control 

For unitary controls, the spectrum of synthesis techniques 
is overwhelmingly wide, and different techniques are better 
suited for different experimental systems. It is well beyond 
the scopes of this tutorial to enter the details of each of them, 
so we are constrained to a brief survey of the most notable 
categories of control design strategies. 

It is also worth remarking that, with the Hamiltonian control 
methods discussed here, the presence of an (uncontrollable) 
environment usually poses significant limits to the achievable 
tasks, as the controllability analysis of Section |V-B| revealed. 
However, the capability of directly engineering open-system 
dynamics can drastically change the scenario, and significantly 
extend the set of addressable control problems. For example, 



it is clear from Section IV-C that these techniques can in 



principle allow for asymptotic state stabilization without the 
necessity of resorting to feedback methods. The scope of the 
so-called environment engineering methods has been investi- 
gated under a number of different assumptions, see e.g. [ 1 00 1 , 

noi], una, nna, m, nm. 



A. Optimal control algorithms 

As already mentioned in the Introduction, optimal control 
methods are widely used in laser-driven molecular reactions 
0, ||9]. A recent control-oriented introduction to quantum 
optimal control can be found in [48]. A cost function often 
used in this context is for example 



J = (i>(T)\M\ij(T)) - 



u 2 dr 



i.e., simultaneously maximize the expectation value of a target 
observable M and minimize the "fluence" (energy) of the 
control. A necessary condition for optimality is that the first 
variation of J subject to the Schrodinger equation (jTTJ van- 
ishes. The corresponding Euler-Lagrange equations are then 
given by ( fTTj ), together with the adjoint equation for the co- 
state x 

fx =-i(H Q + uH l ) X 
\x(T) =M|V(T)> 

and the control u(t) = -1m[{x(t)\Hi\ijj(t))], see e.g. lfl05ll 
for the details. These Euler-Lagrange equations are normally 
solved numerically, and a plethora of numerical schemes have 
been developed for this and similar formulations, which often 
enjoy monotonically convergent properties B105I . II106L In 
particular, iterative algorithms for generating piecewise con- 
stant controls can be subdivided into Korotov-type (in which 



each time slice is updated sequentially) |107| and GRAPE- 
type (in which all time intervals are updated concurrently) 
1 1 08 1 . These methods are surveyed and compared in 1 1 09 1 . 
Alongside the numerical schemes, a few analytical results have 
appeared in recent years, based on the explicit calculation of 
the extremal solutions of the Pontryagin Maximum principle 
Ml 101 . applicable only to low-dimensional systems. 
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B. Lyapunov-based design 

An alternative approach for the generation of open-loop tra- 
jectories consists in using a "feedback on the model" strategy, 
i.e., on solving the control problem as a feedback problem 
and using the trajectories produced by the simulator as open- 
loop controls. This allows the complete bypassing of the issues 
related to the complexity of the optimal control schemes. For 
state vectors, this approach is followed for example in 11111 . 
Ill 121 and for density operators in 11131 . Ml 141 . For a closed 
system such as ([T3J, with H(t, u) = H + uHi, the Lyapunov 
design relies essentially on a Jurdjevic-Quinn condition and 
LaSalle invariance principle (see 111 131 ). i.e., on choosing as 
Lyapunov function a distance from a target state pd (p, Pd € C, 
i.e., isospectral) 



and design of quantum dynamics on the systems of interest 
111 171 . We here only briefly sketch the ideas underlying the ba- 
sic Dynamical Decoupling (DD) technique for suppressing the 
interaction with the environment, referring the reader to e.g. 
11 181 . B119I . Ill 171 for more details and recent developments. 
Consider the bipartite system/environment setting described 

We 



in Section |IV-A| with the Hamiltonian described by ( |20| ) 
assume the interaction Hamiltonian Hg£ to be of the form 
Hss = J2k=i <8> Ek, with Sk being operators acting on 
the system space Hs and Ek being an operator acting on He . 
To control the evolution, we rely on a time-dependent control 
Hamiltonian H c (t) that acts on the system alone. In most DD 
protocols, H c (t) is taken to be cyclic, namely, the associated 
propagator U c (t) = Te~ % fo H A s ) ds j s periodic: 



1 



1 



V(j>d,p) = ^ II /Orf - p\\ 2 = -tr (p 2 d ) - tr(p d p) + -tr (p 2 ) . 

(40) 

Assuming for simplicity that pd is a fixed point of the free 
Hamiltonian, [— iHo, pd] = 0, noting that the purity is an 
invariant for unitary evolution and differentiating (Hob one has 



U c (t) = U c (t + T c ), 



(43) 



V = utr ([-i.ffi, Pd]p) ■ 



(41) 



which is readily made into a negative semidefinite function by 
choosing 

U=-tv{[-iH l , p d ]p). (42) 

Local asymptotic stability can be achieved when the following 
Kalman-like rank condition is satisfied by the system lin- 
earized around pd 11131 . Ill 121 



for some T c > 0. This implies that U c (nT c ) = I, n € N. 
Suppose we choose a piecewise constant control propagator: 
ideally, it can be generated by a discrete-time sequence of im- 
pulsive, unbounded controls. Let us set U c (t) = Gj, jAt < 
t < (i + I) At, with = {Gj}™^ a finite set of unitary 
operators and At := T c /n g . With these definitions, the full 
propagator U(t), accounting for both the free Hamiltonian 
H t ot and the control action H c (t), can be expanded in Magnus 
series [120], and for t — T c one gets: 



U(T C 



-HH 1 - 



H^> + H^>+...)T C 



(44) 



dim 



^span C 



ad f 



iHo 



-iH llPd ], 1 = 0,1,. 



dim (T C) where the first-order term is the average Hamiltonian: 



where ad^B = [A, B], and T Pd C is the tangent space at pd- 
For strongly regular Hq and Qh x fully connected this condition 
is always verified. The attractivity achieved by this feedback 
design can never be global for topological reasons: C is a 
compact manifold without boundary, hence it is not continu- 
ously contractible to a point 11 151 . The obstructions to global 
stabilizability are spurious equilibria p p E C corresponding 
to "antipodal" points of pd in C: in a basis in which pd is 
diagonal, p p are permutations of the diagonal entries of pd 
(for N = 2, p p is indeed the antipodal point to pd on S 2 ). 
In particular, for "generic" C (characterized by a spectrum 



Pi,...,Pn, A*j f 1 MfcJ> ^ is a Morse function |114|, i.e., 
V(pd,p) ^ except for the AM hyperbolic critical points of 
V. Of these, one (pd) is a global minimum (and a sink for the 
closed-loop dynamics (|T5j-(|42j), another is a global maximum 
(a source), and the remaining are all saddle points. All closed 
loop trajectories converge to pd except for a zero-measure set 
(stable submanifolds of the saddle points) 11141 . 

C. Average Hamiltonian Methods and Dynamical Decoupling 

A large family of pulsed-control protocols that rely on 
average Hamiltonian techniques have been developed for the 
control of closed and open quantum systems. They are inspired 
by pulse sequences in NMR [12], and have been successfully 
applied to other settings (from solid-state BTl to optical 
systems |116|) for suppression of undesired noise components 



i? (0) = ±r I lJ2 Uf c( t ) S Mt)®E k )ds 



vfc=l 



q / 1 n " \ 



(45) 



fe=i \ a j=i 



The evolution is then evaluated after K control cycles are 
applied in a fixed interval [0,T], T = KT C . Considering the 
(ideal) limit K — > oo with fixed T, it can be shown under fairly 
general conditions that the higher order terms in ( |44| become 
negligible, and the full propagator can be approximated by the 
average Hamiltonian U (T) e 



-iH^T 



In the early formulation of DD 



<5 is chosen to 



be a (finite) group and it can be shown that the expression 
between brackets in ( |45| l defines the projection of every S 
onto the commutant of &. Properly choosing one can then 
cancel the effect of the average Hamiltonian H^°K Hence, 
this control strategy has been extensively used to make the 
interactions with the environment negligible for the system in 
the fast control approximation. Building on these basic ideas, 
a wide spectrum of decoupling-like strategies have been de- 
vised, including effective cycles using bounded control pulses, 
concatenated protocols to address higher order corrections, 
optimization of time intervals, and techniques for engineering 
the desired dynamics while decoupling the system from the 
environment II 171. 
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D. Learning algorithms for control design 

As we recalled in Section [TJ the control of chemical reac- 
tions has been one of the first tasks of interests for quantum 
control: learning algorithms have been successfully used to 
iteratively design a laser field in order to obtain a desired 
population transfer, to manipulate fluorescence signals and 
photodissociation products and other applications iflOl , 11211 . 
0122L see (8) for a recent survey. While on each cycle the 
control is in fact in open-loop, a closed-loop iterative method 
is employed to generate optimal control actions. Starting with 
a trial control input (may be as well a quasi-random field 
[10 1), the typical iteration entails: (i) a fast experimental test 
of the last generated field, with in particular a measurement 
or evaluation of some cost functional; and (ii) an algorithm 
that based on the performance of the previous control choices 
provides the new trial field. In ifTOl . in particular, genetic 
algorithms have been employed to seek an optimal control 
field, with the cost functional depending only on the final 
state p(T), namely J(T) = tr ((p d - p{T)) 2 ) . Other more 
recent approaches commonly employ steepest descent and 



other optimal control algorithms, see Section VI-A 



As a result, one finds that it is somehow surprisingly easy 
to find effective control fields, at least when the control con- 
straints are not strict. This and other considerations have led 
to an extensive analysis of the "quantum control landscapes", 
that is, of the topology of the surfaces defined by the cost func- 
tional when the control parameters are varying on the available 
set (see e.g. |123|). In the absence of control constraints 
they are conveniently "trap-free", namely steepest descent 
algorithms lead to global optima. Under practical restrictions, 
however, the situation may become more complicated. 

VII. Synthesis Methods for Feedback Control 

Feedback control methods for quantum systems can be 
grouped in two main families. The first one, that includes 
measurement-based feedback methods, involves some kind of 
measurement on the system, direct or indirect, that produces 
a classical output signal, which is then fed to a (classical) 
controller in order to determine the control input. 

The second, on the contrary, does not require the transition 
to classical information: typically, the system of interest is 
dynamically entangled, and hence shares its quantum infor- 
mation, with another quantum system, e.g. a quantum field 
acting as an output signal, which in turn is fed to a fully 
quantum network, acting as a quantum controller. The latter 
is engineered to feed back an input field to the system in 
order to achieve the desired control task. The overall evolution 
of the system-signals-controller network being unitary, this 
approach is typically referred as coherent quantum feedback. 
The first example of a coherent quantum feedback is the all- 
optical feedback presented in 1 124|. Since then, a considerable 
control-oriented literature has been developed, see e.g. |74|, 
lfT25ll . Ifl26l . fl271 . Ifl28ll . Ifl29l . In the following, we present 
the most common approaches to measurement-based feedback 
control, and briefly introduce the reader to the language of the 
relatively unexplored world of quantum feedback networks. 



A. Output feedback and feedback master equation 

Let us consider an evolution of the form ( f34] >. As for a 
classical SISO control system, the simplest form of feedback 
control is indeed output feedback, where the control input is 
a static function of the output signal. If we assume that there 
is no delay due to the feedback loop, the resulting evolution 
is Markovian. Output feedback techniques have a wide range 
of applications, including protecting entanglement in optical 
cavities |130|, spin-squeezing 11311 . cooling of trapped ions 
1571 . engineering quantum information f70l . error correction 
1 132 1, and line-width narrowing of atom lasers 11331 . 

Consider, as the feedback action, the Hamiltonian Hf(t) = 
FdY t , where dY t is the output signal and F — a 
time-invariant Hamiltonian. Here we assume perfect detection 
efficiency rj = 1, but the model can be extended to the non- 
ideal case [76 j. Computing the infinitesimal evolution resulting 
from the measurement action (instantaneously) followed by 
the feedback action leads to the Wiseman-Milburn Markovian 
Feedback Master equation (FME) [63], 11731 : 



dt 



Pi 



-i[H to t,Pt]+V(L-iF,p t ) 



(46) 



where the new Hamiltonian is H to t = H+\{FL+L^ F). Note 
that the resulting equation is indeed in Lindblad from, and it 
thus represents a valid generator for a quantum Markovian 
semigroup, that can be thought of as the average closed-loop 
dynamics with respect to the noise trajectories. The dynamics 
we obtain are still in the form of a QDS generator, but the 
noise operator depends on both the measurement and control 
actions. 

The primary task of feedback control, in the classical as 
well as in the quantum domains, is to attain stabilization of a 
desired state. The problem for Markovian dynamics has been 
extensively studied, with a focus on a single two-level system 
under different control assumptions 11341 , ||30l , 1751 , |69|, 
1751 . A general pure-state stabilization problem for controlled 
Markovian dynamics described by FMEs is addressed by the 
following result, which is a specialization of the more general 
subspace-stabilization problem of [69 1. 

Theorem 7: For any measurement operator L, there exist a 
feedback Hamiltonian F and a Hamiltonian compensation H c 
able to make an arbitrary desired pure state pd GAS for the 
FME (|46j> iff: 

[p d ,{L + L^)]^Q. (47) 

The proof of Theorem [7J yields a constructive algorithm for 
designing the feedback and correction Hamiltonians needed 
for the stabilization task. 

Example 7 (FME state-preparation for two-level systems): 
Consider a two-level FME of the form (R6j. Assume H = a z , 
and L = \a x . Without loss of generality, let the target state 
be written as pd = diag(l,0), and write, with respect to the 
same basis, 



L-iF = L 



Is lp 
Iq Ir 



h* P h R 
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The pure state pd = diag(l, 0) is a globally attractive, invariant 
state for a two-dimensional quantum system iff: 

ihp-^i* s i P = 0, l Q =0, Ip^O. (48) 

It is easy to show that engineering L = a + indeed stabilizes 
pd- This can be attained by properly choosing the feedback 
Hamiltonian. The measurement operator L satisfies the condi- 
tion for stabilizability of Theorem [7] hence pd is stabilizable. 
It is easy to see that the needed feedback Hamiltonian is 
F = ~\<Jy In this case ^(FL + F) = 0, and no additional 
Hamiltonian correction is required, thus H tot = H. 

B. Filtering-based feedback 

A richer control strategy with respect to the simple output 
feedback can be devised by exploiting the fact that the SME 
p4| > describes the dynamics for the state estimate, conditioned 
on the measurement record and depending on the control law. 
Assume that it is possible to integrate ( [34] i in real time, starting 
from some a priori initial condition: at each t an updated 
estimate of the system state p t is then available. As in the 
classical case, this can be used to design a state-feedback law 
f(pt)- The generic stability of the filter has been discussed in 
11351 , and a separation principle has been shown to hold 1 136|. 
The system dynamics, assuming that no dissipative component 
other than the measurement is present, is typically assumed to 
be of the form: 

dp t =( - i[H + f{ Pt )H llPt ] + V(L, Pt ))dt 

+ VvQ(L,Pt)dW u 

with fixed Hamiltonians Hq and Hi, and < r\ < 1 account- 
ing for limited efficiency in the homodyne-type detection. Due 
to the topological structure of the state space, the feedback 
design generally presents significant difficulties, and cannot be 
pursued by standard methods 11371 . 111381 . A first way around 
these difficulties is offered by numerical optimization, in 
particular semi-definite programming \29\. Consider the same 
two-level system as in (j36j, with Hamiltonian H(t) = u(t)a y 
(for simplicity we assume A = 0), where the control u(t) is 
the amplitude of the magnetic field in the y-direction. That is, 
we have: 

dpt = - i[u(t)a y , p t ]dt + v(a z p t a z - p t )dt 

+ y/rp(a z p t + p t <y z - 2tr (cr z p t )p t ) dW t , 
or, in terms of the Bloch vector: 

dxt — (u(t)z t — 2 ux t) dt — ^JrjvxtZt dWt 

dy t = -\vy t dt - ^/rjvy t z t dW t (51) 

dz t = -u(t)x t + ^/rjv (1 - zf) dWf 

The idea is to first fix a feedback control law like the following 
affine function of the Bloch vector |29|: 

u{t) = --(l + z t )+2x t , (52) 

The choice stems from geometric considerations: the depen- 
dence by both z t and x t and the particular choice of parameters 
ensures that the control is zero at the target state, but not so on 
the antipodal state, i.e. the other eigenvector of a z that would 



be stationary for the free dynamics. Next, one can use existing 
numerical algorithms to find a polynomial Lyapunov function 
V(p) such that LV(p) can be decomposed as a (negative) sum 
of squares, where L is the infinitesimal generator associated 
to the diffusion ( |50l > |81|. Given the previous analysis of the 
invariants for the uncontrolled diffusions and invoking the 
LaSalle-type results of llSTl . the effectiveness of the control 
law can be readily proven. 

There are no systematic and efficient ways of designing 
stabilizing controls for arbitrary SMEs. The problem has 
however been solved for a class of A^-level spin systems, by 
resorting to a "patched" control law [ 80 1 . Consider a system 
of the form <J34|>, where Hi — F y , and L = F z , where F y and 
F z are N -level spin operators llSOl , ll5D . 

Theorem 8: Let the target state pd correspond to an eigen- 
state of F z . Consider dynamics driven by ( |49| i and the follow- 
ing control law: 

1) u t = -ti(i{F y ,p t }pd) if to(PtPd) > 7- 

2) ut = 1 if Hptp d ) < 7 /2. 

3) If p t e B = {p : 7 /2 < tr(pp d ) < 7}, then 
Ut = — ti(i[Fy, pt\Pd) if Pt last entered B through the 
boundary ti(ppd) = 7, and u t = 1 otherwise. 

Then there exists a 7 > such that u t globally stabilizes ( |49"| ) 
around pd and E(p t ) — > p& as t — >• 00. 

The idea underlying the result is to employ a stochastic 
Lyapunov-based feedback law in a neighborhood of the target 
state, and "destabilize" the rest of the state space via a constant 
control. For systems of the form ( |49] i, not just stabilization 
problems but a number of optimal feedback control problems 
have also been considered, see e.g. B139L 1114011 . B1411 . 

C. Quantum optical networks 

1 ) Basic concatenation rules and reducible networks: One 
of the main advantages with quantum systems where the 
variables of interest are represented by traveling light fields 
is that, with good approximation, the interactions between 
the field and cavities, beam-splitters, mirrors, and any other 
component of the network are local in space and time. This 
allows one to define quantum input and output signals from 
the elements of the network, and thus interconnect a number 
of these in order to design e.g. some desired input-output 
behavior. A comprehensive review of this approach goes well 
beyond the scope of this tutorial introduction, so we limit 
ourselves to a sketch of the basic formalism for describing 
these networks. Recall that the key equation for describing 
the field-system interaction without measurements is ( f30] >, 
which is completely specified by the (operator) parameters 
G = (S,L,H). This corresponds to a SISO block for our 
network. If we now want to couple multiple systems through 
input and output fields in a network, we can construct a joint 
model using two simple concatenation rules: 

Connection in series: If the input of a system associated 
to parameters Gi = (Si, Li, Hi) feeds its output field into 
a second system G2 = (S2, L2, H2), the joint system can be 
equivalently described as a single system G = G 2 <G l7 where 

G = {S 2 Si, L 2 + S 2 Li, Hi+H 2 + (lIs 2 Li) s ), 



16 



X s indicating the skew-Hermitian part of X. 

Concatenation: If a system associated to parameters Gi = 
(Si,Li,Hi) is combined with another system G2 = 
(S2, L2, H2), the joint system can be described as a single 
system G = Gi EH G2 where 



G = 



Si 

s 2 



Li 
L-2 



,Hi + H 2 



A network of systems that can be described only through series 
connections between subsystems of a concatenation is called 
a reducible network. Not all networks are reducible, however, 
and a general Hamiltonian theory has been presented in [ 142 1. 
An approach for formulating control design problems in this 
setting, based on a quantum version of the passivity approach 
of Willems, has been developed in I128L 

2) Linear networks: Consider a quantum system described 
by a quantum harmonic oscillator, that is, with some position 
and momentum operators satisfying the canonical commuta- 
tion relations and a quadratic Hamiltonian (see Appendix [B] 
for a brief review of the system), and assume that the initial 
state is a coherent state. If we now further assume S and 
L to be scalar, the state remains coherent throughout the 
evolution, and the input-output relation ( [3T| becomes time- 



invariant: dB n 



SdBi, 



Ldt. 



The idea can be generalized to a network of these linear 
quantum systems, obtaining a model of the form: 



dx{t) = Ax{t)dt + Bdw(t); x(Q) 
dy(t) = Cx{t)dt + Ddw(t), 



x 



(53) 



where x(t) — [%x(t) . . . x n (t)] T is a vector of self-adjoint 
noncommutative operators on an appropriate Hilbert space, 
dw(t) is the (noncommutative) increment of the vector of the 
input signals, dy(t) of the output signals, and A, B, C and D 
are matrices of appropriate dimensions. 

A standard form can be introduced, in which the initial 
condition x(0) = xq of the system is taken to satisfy the 
commutation relations 



[xj(0),x k {0)] = 2iSj k J, j, k = 1, ...,n, 



(54) 



where J = [ _°i J ] ■ The input w is further assumed to admit 
the decomposition 



dw(t) = p w (t)dt + dw(t) 



(55) 



where w(t) is the noise part of w(t) and f3 w (t) is the control 
to be designed. The noise w(t) is a vector of self-adjoint 
noncommutative processes whose increment satisfies the Ito- 
like multiplication rule dw(t)dw T (t) — F^dt, where F& is a 
positive semidefinite Hermitian matrix. 

Many results from optimal and robust linear control theory 
have been adapted to this class of models 11261 , 11431 , 



[129], one of the key difficulties being to ensure the physical 
realizability of the controller one obtains from the numerical 
optimization procedures. One of the most relevant features of 
the approach is arguably the possibility of systematically de- 
signing and realizing quantum feedback controllers, or coher- 
ent controllers |129|: namely, one can design a new quantum 
network whose output is exactly the (operator-valued) control 



j3 w (t). A typical control problem is the minimization of a 
quadratic functional 

J{z) = [ 1 (z{tfQiQz(t))dt, 
Jo 

where (•) denotes the expectation, and the "augmented state" 
z(t) includes the internal state of both the system and the con- 
troller. Despite the linearity of the interconnected system, the 
optimization procedures are complicated by the nature of the 
physical constraints, making the problem non-convex. Recent 
numerical results in Ml 29! showed that a coherent controller 
can outperform a (linear) classical one in the quantum LQG 
problem, suggesting that fully-quantum controllers are not just 
an intriguing theoretical challenge, but a potential advantage 
in quantum control theory. 

VIII. A BRIEF OUTLOOK 

Manipulating physical systems at the quantum scale poses 
great challenges to the control engineer. A huge research 
effort has been spent in the last decade in the attempt of 
developing the early approaches to quantum control into a 
sound mathematical theory, as well as in devising techniques 
tailored to the most diverse experimental settings. However, a 
lot remains to be done, both connecting the existing pieces 
of theory into an organic framework and providing viable 
solutions to old and new open problems. We provide in the 
following a short list of some promising research directions 
and open problems of theoretical interest. 
Control of open quantum systems: As we have seen in the 
study of the controllability of the MME, the effect of noise 
can be destructive, drastically limiting the capabilities of the 
most widely-used, open-loop control designs. In order to 
be able to manipulate a quantum system on a sufficiently 
long time scale, e.g. for implementing a complex quantum 
algorithm, the system must be endowed with mechanisms able 
to fight the action of the noise. Beside open-loop control 
method 1 1 171 . more research is needed in order to assess 
the potential of feedback methods for error correction |132] 
or for engineering protected codes 11691 . We believe that the 
most interesting and compelling developments in the theory 
of quantum control will regard open systems, in particular 
the systematic analysis of synergistic interactions between 
the system and its environment, be it a properly engineered 
interaction or a measurement apparatus 11441 . II 1451 . 
Quantum controllers for quantum systems: The idea of using 
a quantum system as a "controller" for another quantum 
system, originally formulated in [ 124-1, 1 146 1, has been recently 
developed in the framework of quantum optical networks. 
In this case, it has been shown that the feedback quantum 
controllers can potentially have better performances than their 
classical counterparts. Hence, new research is needed in order 
to assess the potential of quantum controllers, to provide a 
unified view on the problem, and to develop systematic design 
procedures. 

Feedback control of non-Markovian models: While the lit- 
erature on open-loop control ideas based on dynamical de- 
coupling is vast, feedback control of non-Markovian control 
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models remain relatively unexplored (at least form a control- 
theoretic viewpoint). The master equation approach is receiv- 
ing growing attention in the mathematical physics literature, 
especially in determining standard forms and quantifying the 
non-Markovianity of the evolution, and its potential applica- 
tion to "quantum biology" problems makes those models a 
natural candidate for control oriented studies. Recent devel- 
opments on non-Markovian stochastic dynamics make those a 
natural object for further research on feedback control |147|. 
Large scale systems and quantum information processing: The 
application of quantum control techniques to high-dimensional 
systems, or large "networks" of simpler systems, offers a num- 
ber of formidable challenges to the control engineer. While 
the improvement of numerical optimal control algorithms is 
certainly one of the needed steps in this direction, we are 
facing some more fundamental theoretical issues. For example, 
it is by now well-known that controllability is connected to 
the possibility of breaking all (dynamical) symmetries and that 
most multipartite quantum systems can be controlled by means 
of a few "actuators" [ 148 1, II 1491 . but a theory of optimal 
placement of these actuators is still missing [ 150]. Another 
set of problems is posed to the quantum control community 
by quantum information processing techniques, most notably 
quantum computing. In this field, the system is a register com- 
prising a large number of (logical) qubits, and the need is for 
effective and scalable algorithms for entanglement generation, 
gate synthesis with high fidelity, and noise suppression. Our 
impression is that the most interesting developments will be in 
techniques that go beyond Hamiltonian control 11511 : stringent 
locality constraints, and the necessity of incorporating more 
control techniques to tackle a single task, make the challenge 
formidable, and yet extremely intriguing. 

Appendix 

A. Notations 

Throughout the tutorial we will make use of Dirac's no- 
tation, inherited from the physics literature. A quick review 
of this and other relevant concepts is provided here. Some 
standard references for quantum mechanics are e.g. lIBTl . (TJ. 
We will use i for the imaginary unit, and c* will stand for the 
complex-conjugate of c e C. 

Spaces and Operators: Consider a finite-dimensional sep- 
arable Hilbert space H over the complex field C, H — C N . 
When it is convenient to explicitly specify the space dimen- 
sion, we shall denote by H N an iV-dimensional Hilbert space. 
We denote with Ti) its dual space, i.e. the Hilbert space of 
continuous linear functionals on H. f S('H) ~ C""" is the set 
of linear operators on H: The natural inner product in 03 (H) 
is the Hilbert-Schmidt product, namely (X,Y) = tr (X^Y) , 
where tr () is the usual trace functional (which is well-defined 
in a finite dimensional setting). We denote with X* the adjoint 
of X. F)(H) is the subset of OS('H) of Hermitian operators. 

Given two linear operators X, Y on H, we indicate with 
[X, Y] := XY-YX and {X, Y} := XY + YX, respectively 
the commutator and the anti-commutator of the two opera- 
tors, /subscript stands for the identity operator on the space 
"^subscript, while Id, d e N is used to indicate the identity 
operator on C d . 



Dirac notation and Matrix representation: Given a Hilbert 
space H, is used to denote a vector (called a ket) in 
H, (ip\ denotes its dual (a bra), and (ip\(p) denotes the 
inner product. When A is a linear operator on H, A\ip) 
denotes the image of \ip) through A, and (ip\A := (A\ip)y. 
Thus we have an unambiguous meaning for the notation 
(ip\A\<p) = (ip\(A\tp)) = (A\iP)y\ip)). The "external" product 
notation IV'Xvl stands for the linear operator on H defined 
by WM(IO) = IV>)M0, for all |0 G H. Hence, if 
= lj represents the orthogonal projector onto 

the one dimensional subspace generated by \ip). 

In matrix representation, \ip) G H ~ C N are represented 
by column vectors, so (<j>\ e 1-0 ~ are row vectors. 
X G 03(%) ~ C NxN are thus represented by (generic) NxN 
complex matrices, the adjoint X* becomes the transpose 
conjugate of X, and hence H e ?)(H) are represented by 
Hermitian matrices. 

Tensor-products and partial trace: If Hi , H 2 are two Hilbert 
spaces, the notation Hi®H<i refers to the closed linear span of 
the tensor-product vectors |^>i)(8> \ip2), where G Hi, \tp2) G 
H 2 . In matrix representation, it corresponds to the Kronecker 
product. Given X\ G ( B(Hi),X 2 G X\ ® X 2 is the 

linear operator on Hi (g)H 2 , such that Xi(g)X 2 (\ifji)(g)\ip 2 )) = 
® X 2 {\ih)), where G Hi, \ip 2 ) G H 2 , and 

extended to the whole tensor space by linearity. The partial 
trace of X over H 2 , tr 2 (X), is the only linear functional on 
03 (Hi ® Hi) such that for every X x G 03 (Hi), the above 
property holds. It can be defined starting from factorizable 
operators as: Kz 2 (Xi <Z> X 2 ) = Xiti(X 2 ), and it is extended to 
all X12 G 03(%i ®Hi) by linearity. See e.g. [l \ for a detailed 
discussion. 

B. Quantum harmonic oscillator 

Let us recall the key elements of the quantum oscillator 
model with the "ladder" operator method, originally due to 
Dirac, referring to BTl for a more complete treatment. An 
harmonic oscillator of frequency cj in quantum theory is 
an infinite-dimensional system with discrete energy levels 
E n = (n + n = 0, 1, 2, . . . , with corresponding energy 
eigenvectors \ip n ). Let us define the annihilation and creation 
operators, a and in terms of their action on the energy 
eigenbasis: 

a\ip n ) '•= VnlVn-i), a^\ip n ) := y/n + l\ip n+ i). 

The definition reveals the reason for their names: a lowers 
the energy level, subtracting an energy "particle" or quantum, 
while A^ raises the energy level, adding a quantum. They also 
satisfy the canonical commutation relation [a, a 1 ] = I. 

In terms of these operators, one can then define the counting, 
or number operator, N := a) a which is diagonal in the energy 
eigenvector basis (hence also called the number basis) and 
N\ip n ) = n\tp n ). It is the observable associated to the number 
of quanta in the oscillator. The Hamiltonian can then be written 
as H = uj(N + |J). In the Heisenberg picture, we have that 

— a = i\H, a] = —ioja, — a) = i\H,a)\ = iuia) , 
dt L J dt 1 J 
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so that a(t) = e - JtJt a(0), at(t) = e iwt at(0). Thus, they are 
energy eigen-operators for the evolution at each time. 

An equivalent description in terms of the canonical position 
(x) and momentum (p) operators is recovered by defining 



x(t) 



2 o(i) + ot(t) 



p(t) = y/2r 



-a(t) - ot(t) 



2i 



(to is the mass of the particle) satisfying the canonical com- 
mutation relation [x,p] = i, so that the system Hamiltonian 
acquires the familiar quadratic form 

p(tf 



H = 



1 



tow x(ty 



2m 2 

An particularly interesting class of states of the harmonic 
oscillator are the coherent states. They are the eigenstates 
of the annihilation operator a. In the number basis, they are 
parametrized by the complex eigenvalue a and defined as 



\a) 



CO 

£ 

n=0 



as 



[5] 



For these states, the expectation of N is precisely \a\' 
is its variance. Under the evolution driven by the harmonic 
oscillator Hamiltonian H = oj(N + \l) a coherent state 
remains coherent with the same amplitude and an oscillating 
phase, that is |a(i)) := e - lH \a(0)) = (ae-^+s)*). 
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